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Toward a grammar of special effects 


The aim of this paper is to show that special effects are not an 
c. el Vee’ a i ~ 
trick effects from the magic department, but formal derivations (eon cf 


the two basic technigues of cinema, ~the~art—~of—the-mevine—image | which 


are cut and superimposition, comparable-if we want to follow a suggestion 
to 
of Roman Jakobsorr metonymy and metaphor as the two basic procedures of 
: } 


¢ language. | 
& os td tae is & 4 a +NE 1 SAP er et AWE \' glee a Le cae. a a oe eae aad: 
To fully understand this concept we have at first to forfget what we have yep! ¢ 


learned about the history of cinema, which always was shown to us under 
- 0 Va 
yoK 7h OT ~ ~ Y 

the perspectives of literature Ueareation ad the humanities and ‘ve Very 


recently arly in the context of the socio-economical or viliceaiaiaatal 


it ys 
evolution (see Paul Virilio). For our argument important x to recall 






that xke = 





by thaws 


‘ the @ of the mving image has to be divided irf/the art of | 


the cinematographic movi the electronic movi image. Both 


share common fundamentals, but both have aise-a different histoi—gg which %tU™ 


sometimes parallel and sometimes asynchronous. What they have naturally in 
av’) 


common ie the destruction of the aesthetics and ontology of the stable image 
tw he td OU 
ly) (painting, sculpture): The §question is even;=s£ an ontology of the oo 


if image is even possible or whether the moving image destroys any onbology oh tay 


= the early optico-chemical experiments and 








inventiory, ie discoveries of the fundamental physiological laws governing 
the appearance and disappearance of moving images’. 
ee are 
ve ne hoa 
1824,is based on the fact that the ier eye holds light values for a Pa ion 








Optico-physiologial laws founding the art of the moving image. 





Two of this. fundamental principles are the persistence of vision 

and the stroboscopic effect. 

The persistence of vision was sOmmuates ws by De. Peter Merk Roget 

(later more remembered for his ''Thesaurus'') and is refering to the phenomen, "of 
human perception, known already since the ty ee that A is still seeing 
something for about one-tenth of a second after it has disappeared. The human 


eye holds light values for a fraction of a second - a tenth of a second markimally, 


O&ececond teenth f-a-qeeersriineimetiy, Therefore, if the images before us 


appear in .09 seconds, they will seem to move.If a moving point of light 
can trace an entire image in atenth of a second or less, then the eye will perceive 
the entire image as one and at once. That means », the moving point of light, 


accordingly speeded up, will appear as e circle of light. 


In the same year| also the astronomer and phbicist Sir John Herschel used 
the principle of the persistence of vision to demonstrate the effect of the 
afterimage. gop. the eye retains an image over a tenth of a second longer, 


the image Ss in the retina longer then in front of us. Therefore successive 


> ae. 


still images can fuse in the eating ag speeded d up encugiy Sir Herschel 
sere: if spee ia 


turned a coin fast enough amseems to create the Ssimiltaneous perception of 


both sides of the coin, therefore head and tail of the shilling fused to one 
image. 
Following ne of the great physicist d'Arcy, fit wag another physicist, 
__Michael Farady, the eregt ‘experimental researcher in electricity, .hefcreated | 
— Frethanical device which made use of the stroboscopic afterimage-effect. This 
device was a kind of wheel, a mechanical disk, the famous Faraday disk. 
This disk was a physical-mechanical implementatioti of the persistence of 
vision, the afterimage and the stroboscop i fies printiple. The history of cinemato= 
graphy, of the moving image, starts with this Eataday ¢ ead verti this inventionef by 


eet 


a researcher in electricity. 
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At this historécal moment in the creation of the moving image during the age 


of the industrial revolution , Photography hoaoxnmiogmekxaxxxwedx was still in 
a state of experimentation. niaeiies Fox Talbot achieved a permanent enennen ~ 


{&3s. 
So the host medium was not yet defined. jac the last third of the 19th 


. avtinwns stn 
century, photography was added to the problem of the moving image the result 
and immediate triumph was cinematography, the writing of motion on phe basis 
Rc fore AO f t. -G Lat b.e. 

of photography. ‘On-the-other Hie Tand and before that | was the search of transmitting 

avtutd 
images by electrical means, wast forshadowed Television. Finally, trub%o operating cinema 
fad and television appeared in the same decade. 
But before the history of the art of the moving image was split into two 
different host media, electronic waves or photographic stills and their related 
founding principles, namely scanning or succession, it seems to be the case 

ete. eel) 
that the scanning method of the electronic image peier—teo-the succession method 
onl 

of the cinematographic image was considered the founding principle of the art 


— 


of the moving image. The phenomerf* of the persistence of vision itself was 
di a eg a er 


heme 


experienced as a kind of scemmane experience. ee errived at Ris Chseation: 

Only = their vertical position did the spokes appear straight; otherwise they 

spokes seemed to bend and distort. This illusion was cleraly caused by his eye 

having retained the image of the spokes after they have passed behind the slats. 
Atso The next step in the evolution of the moving image, the erosion 

of the wheel - and it is not a histiygal coincidence that atse Roget “cbserved 

his principle at a wheel - ha¥ features of the scanning principle.The wheel 

was necessary to get a means of acceleration beyond human capability. Only 


with machine acceleration was i ssible ain the nessecary speed and duration | 
i tae 


to make use of the afterimage-effect. The disk was spinning like the coin, but ‘the — | 
succession of the images on the wheel had to be watched teuogh a slot (the former | 
vertiyal slat of a fence). The succession and oe principle combined in the 


stroboscopic disks of Plateau and Stampfer. nee before that, there was the 





eT hw : 
Thaumatrope, invented 1825 as a toy by W.H.Fitton and J.A.Paris, weteh was a cardboard 


disk with the drawing of a bird one side and the drawing of a cage on the other 
rineiple of 

side. This optical toy employed \eretetence of vision . When the disk was spin, 

or twirled rapidly on a string, 


the bird would appear to be in the cage - the very first superimposition. | 


From ee i ate a had age sel 3 basic Sata arc, Na scamming, the succession, 
Lf C se Tue nT Se 


the superimpositiony. The ely ae by Plated, Stampfer ,Horder, which 
delivered moving images, made use of all t three principles ) Seige the | 
scanning principle is necessarily linked with the principle of succession. | 
First I break down a continuous phenomen”'in”4 discrete succession of lines, or 
ee or frames. Then I trace these lines or points or frames so fast in my 
r a TV-screen 

reti that they appRax seem to appear Simultaneously. In the case of a 
i Faraday => points of light move so fast that the successive points are | 
poorer simultaneously Lihe _the _Scan iines on a TV screen move so fast that 

_they appear to be simultaneous, ey creating the illusion of unity and 

continuity of motion.The scamming principle as the bis of TV and Video 

corresponds with the succession principle of the cinema, which is the 


. 
ee 
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# The stroboscopic effect, discovered 1832 by Simon Stampfer and oe Sa Plateau, | 
! “Gael the afterimage, 


j is based on the law of persistence of vision\and formulates the awe mentioned 


} 
a 


similtaneous perception of successive frames. 


3 steps of fraction, acceleration and simuiltaneity in termsthat folflow the 
“esribdass Sevag ite, Wi: ia elaaldighe interpretation: 
I interrupt a motion ine phases a second and show them again within a ae Moo. 
| these phases would appear as unity and continuity. Simon Stampfer build 
the Stroboskop and Joseph Plateau the Phenakistioskop.Together with Faradays 


disk they have been the first machines to create the illusion of motion 


based on the persistence of vision and the afterimage, which follows the 


persistence. Since-the-eye-reteins—an—image over_a.tenth of a second J 





ia 


The stroboscopic diges of Farady, Plateau, Stampfer 
leAd to the invention of the "Vitaskop" or "Stroboskop" (Stampfer) or 


Phenakistoskop" (Plateau) or Phantaskop", which consisted of 2 diggs where 


one disd¢ showed different phases of motion and the other disk had slits. 

These two disks were rotated mechanitally with the help of a crank. Here for 
move and live. -George Horner @: approved the Phenakistaskop and built a "Zoetrop@, 
The zoetrope used* revolving drum with a succession of drwaings around the 
lower inside and with vertical slits at the outside to look through, instead of 
the slotted disks.When the revolving drum was spun,the illusion of coherent, 
continuous movement appeared. We see these disks and drums as evolutions of the 
wheel, the central metaphor of the mechanical age and the mechanical foving 
unage, the cinema. 

¥ Pee Uchatius ea Stroboskop't with ee light projection. 
He was not sie erane with the individual perception of motion through the 
Stroboskop~ As ‘offical he wanted to teach his pupils about motion problems 






of the artillery collectively. tmamesbancomngR a Krawings of different 


phases of motion on glages fhe placed on a disk. "A second disk with slits was 
mounted together with the first disk and both moved in a black box with a crank. 
Another combination of scanning and succession, of light projection and 


neuer effect, _ but clearly on the basis of photographic film vhas been 


the Praxinoskop of Enile Reynaud (1877) and the ''Elektrotach skopt! “0887 


y’ 
oh of Ottomag Anschutz. Anschutz used a Geissler Tube for intermittend light 
Ean eae ——— 


a mie eater ee rere ae Me ae 
* Ante, 
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projection of the glas® slides mounted on a disk of steel. 
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What is important hesswer to — in mind) is that the early pioneers of the 
art of the moving image, the physicists, the doctoss, the mathematicians, the 

_ physiologists, the opticians, spoke OF a eee ane tight points. The question 
was, how can I move a point of light fatser’ then a tenth of second in order 
to create {the(illusion of) simultaneous perception of successive points and theret 
the illusion of motion? How can I make use of the persistence of vision, of 


the lazyness of the eye? Only iate the problem turnefl to the simultaneous ia ae 
oP eee esn a t ele eeeen  eret da, eS 





AOA ie nam aN 


of successive frames. In the beginning the terminology was closer to the > scanning 
—— eee Pe vete nig a men oe 


seine of the electronic image than to the frame succession of the < cinema. 


mgs ee 
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The persistence of vision can be interpreted through scanning, thereby leading to the 
- ila eee bie ae ee nee —_————— . 


an en 
a 


electronic moving image, or can be interpreted as a succession of frames, thereby 
Pa 
leading to the cinematographic image. The host of the moving image can:be 


al per, 
video or the photographic film. %the host medium defined, from the basic 
difference, scanning or succession, will follow atso the difference ffage the 


nea 
two host media, which can be definded through the different strategies of 


~~ transition between the moving images :_strategies built on the cut in film, 
strategies built beyond the cut in the electronic image. a tne seinen 
of the persistence of vision, the optico-physiolog#al axiom for the moving image, 
“ . makes the principles of the moving image evident: 1) ‘Fhe break down, the fragmen= 
tation, the interruption, the atomisation, the rupture, the fraction of a 


moving object. 2) fhe simultaneous (‘at once'') perception of successive 


a 


le eb R tare «} Ley iia ee eS 


phases, elements, points, frames.3) the speeding up, the acceleration of the points, 
the frames, the aiid, to overcome the laziness of the fae eye. This third | 


z moment was easy to create with the help of a machine, with a rotating machine, 


with a mechanical disk. Michael Faraday,-the-great—experimentei-researcher—t- 
etoeemt-etey! created HBs such a di#,—~.w “47, 


The atomisation and fragmentation of gh moving phenomena into a succession of 


points and after“ards the lining up of this points through a mechanical wheel, 


« Ars 
madi 


a disk, is clearly forcasting the principle of scanning, which was then 
ww a a ee 


desired ato by Alexander Bain and Frederick Collier Bakewell. 
araday disk, 


If as otten sald the history or Fe MnEe SLaLLO was WIE 
we can conclude that the history of the moving image starts also with the _ 
scanming principle, and therefore spans much more than a century. 
The industrial revolution and the moving image: wie 
wheels, disks, and drums . 
ical acceleration comes into play as necessary link between the atomisation, 
scanning of motion and the successive synthesis of the fractured parts of motion. 
The ee discovery of the persistence of vision had to be matched by 
a) 


a mechanical discovery, tikemstt, to be able to mike full use of the physiological 





discovery. fhis mechanical device, the wheel or the dis, co. id only be undertakery 
in the age of the mechanical wheel or the mechanical motion, in the age of the 
industrial revolution. Therefore it makes historical¥y sense that the people 

who built the cornerstones of the industrial revolution also built the 

cornerstones for the moving image. Therefore I emphasize the fact that the first 
attempts of writing motion, of cinemato-graphy, of a graphical meaktarmr notation 

of motion have been undertaken by the very man who founded the industrial 
revolution, James Watt, the inventor of the steam engine. Watt had problems with 
the motion of the steam in the boiler. To solve this problem he needed a spashieal 
notation of the motion of the steam inside the boiler. The device for this graphical 


(1860) 
notation of the motion invented by Watt was later the starting point for 





graphic investigation and recording of 
motion. Machine motion lead to the graphical notation of motion which led to 
cinematographic motion. The moving machines existed before the moving images. ( 
Only with the help of the moving machines and their metaphor and mean, the wheel, 


the problems of the moving image could be solved. In form of the disk, the wheel 
formed 
wax also the beginning of the electronic image, from Faradgy's disk to the scanning 


disk of Paul Nipkow (1884). 
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The archeology of the electronic imaze; | q ” 
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After the first phase of founding the dispositive of the movigg image, 

which was the optico-physiologigal exploration of the laws governing the 
perception of motion (persistence of vision, stroboscopic and afterimage effect) 
started aa he peered pirat ia ae a physical lay out, a physical 
implementation for these optical discoveries. One lay out became evidently 

the mechanical or cinematographic foundation of the moving image with the 

help of photography (Marey,Muybridge, Edison, Skladancesks, Le Prince, Lumiere) ; 
The other way was the foundation of the electronic image with the help of wirele: 
transmission. 

As the industrial revolution itself can be divided in a mechanical and a 
electronic epoch, the same happens with the moving image. As the postindustrial 
revolution is linked to Transistors , Integrated Circmits, Computers et al, 

we can say that the digital image id the postindustrial version of the moving im 
The mechanical look however of the early cinematic apparatus disguised that 

the scanning principle, wasxaioxceasx the basis of the electronic image, was 
already present before other more cinematic principles became evident. In that 
sense many of the early cinematographic toys forshadowed the scannSits 

electronic es 7 


eo De Gees Seah pee ya AOC 
1840 the Englishmen | Alexan er Bain and Frederick cate mac introduced 


mAh | es . 
ne oles =e Be : 4 ne 


the scamming method fae transmitting images. ie The age ‘is ‘registered a point 
or a line at a time, and a multitude of light values are transmitted one by 
one successively (serially), and then eesaseayiad into a Likeness of the 
original image by a reverse-scamning mechanism. 

The transmission ee ELI pictures by electrical means was discussed in 


Eighteenth Century, before the invention of the telegraph. Facsimile transmissior 


em ern Geiss ence 
—_ lalate eae 


mw regarded as the ies compleint of the telephone, was “ aim. ‘The problem 


ee A I OANA: Tc os «A 
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“was the” transmission system m itself, Serial transmission of massive amount 


ee atten aa a eae 


of data (of v (of varying light values: sensed simultaneously) or massively parallel 


eer 


eee I ney Ae 


syetems, utilizing a large array of sensors . The more sensors, the higher 


the resolution.The technical structure again was built on the known principles ; 





(Ab 


Scanning, succession and simultaneity, the problem was the physical implementation, 


in thé” case the sensors , and the parallel system. 


1870 irish telegraphers experimented with selenium resistf>s and found that they che 





resistivity with varying light conditions. The possibilgty to change and controll 
arouse 
the light values of a system and thereby the possibility to sea transmit and reass 


reassamble a picture with the help of controlled light values George Carey 


val 
from Boston proposed 1875 the first television-system using a mosaic of selebium 


TR llel transmission 
sensors and a separate transmission lines for each sensor.Bu Sypcemmamximproved | 
ee 


° te rN rrr te 


to be totally impractical .obviuos ly only the scanning method would work. 





The telegraph was the first practical use of electricity. The telegraph as ancestor 


he ot ibiietete an tae 


| ae the. electronic image is therefore a logical deduction. Image transmission bys mean 
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of scanning devices was the principa is--telegraphic. research. 
peer , Lacsimi eproduktion over distances was in the beginning the immediate 


goal, but at the end of Nineteenth Century it was clear in theorg how to use- 
-even, 


Scanners to transmit moving images . In the 1880s_ the principle scanning systems 
ete 


have been developped. 





The prismatic scanning of William Lucas from 1882. His scanning system, called 


———— 








ra sues 


__ scansion, suggested that a light beam be focused with prisms , that the prisms be sw 
" oan to swing the light beam back and forth across the scene to be transmitted. 
This was almost identical to the process that takes place in modern video cameras 

or picture tubes, but as a mechano-otpical process instead an electronic one. 

The Scansion system ist the direct ancestor of the scanning device used in the 

Jean Lazare Weiller invented 1889 the third mechanical scanning system, a disk whose 
periphery was studded with a multitude of small tangetial mirrors, the reflections o 
which struck a selenium cell. Emest Alexanderson of General Electric used this 
system in the late 1920s . 


The most successful scanning device was invented by Paul Nipkow, a german engineer 


employed by a railway signal company. The Nipkow disk from 1884 consisted of a singl 





WAG 


rotating disk with a spiral arrangment of perforations along its periphery.The spir: 
made only one circttit about the ciéumference of the disk, and the distance between t 
innermost and outermost perforation was equivalent to the height of the frame 

being scanned, while the distance between perforations was a little more thanthe 
width of the frame. Each perforation passed over the frame in a slightly Saved 
path representing a single scanning Line . Nipkow calied his patent "Electronic 


Telescop’ . Especially in Nipkows round rotating disk with holes in form of a spiral 


ordered to dissect the image into lines we disuwover the return of Faradgys disk. 

The basic process of image trahsmission and therefore of Television was found: 
TELE “GRA pT AN hesldclgnet Male ron] - 

But before ‘serial scanning could really triumph it had to move from the 

mechanical era to the electronic. Henry Adams, the american higorian of velocity anc 

pragress, wrote correctly:''The modern world began in May of 1844 when the telegraph 

began and the first steamship came into Boston harbor". In shis statement 

you will not only find defined the histwrical background for the moving image, 

which is the industrial revolution, the mechanical age, the machine motion 

on steam basis, but also the next step, the transition to information transmission 

with wire or wireless. As I have said, around 1908) also the scanning principle 

was demonstrated. After the telegraph facsimile transmission was the most 

important step to television. The first successful use of a mechanical scanning 

system for image transmission, won transmission of a photograph of the french presic 

( his ; first famctioning fax machine 

by wire in 1904 through Arthur Korn. was developed by Korn as a first step toward a f£ 

practical television system, in the research of which Korn has participated in the | 

1390s. 


4O years after the telegraph and the first fax transmissions new tools and devices 


for image transmission have been discovered and the host medium for the electronic 
yaa 


ee 
poe : 
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image was found. Heinrich Hertz demonstrates the existence of electromagnetic 
waves , 1873 found by James Clerk Maxwell. Hertz waves are the bases for wireless 


YN 
transmission. 1897 Ferdiand Braun built a cathode ray & oscillograph tube, 





Which made electromagetic waves visible.This Braun Tube is the ancestor of the 
TV Tube. Ancestors to Braum's tube have been the vacuum tubes by William Crookes 
(1879) and a tube by Julius Elster and Hans Geitel from 188@1, the fexkekx first 
photoelectric tube. The tube produced the current for Signal transmission, but 
electrical amplification was needed to make the photoelectric tube work. 
Experimenting with cathode rays in Crookes vacuum tube J.J . Thompson 

discovered 1897 the electtron, which started the os forrest, electronic 
amplifiers, powertubes. The first practical electronic amplifier, a triode 
vacuum tube, was invented 1906 by Lee DeForést. Forrest had attached a grid 

to the diode (invented 1904 by John A. Fleming, a radio tube) kexemomkk 

for the purpose of controlling. With the diode and the triode start modern 
electronics. 

TT oe 3 Gee Boris Rosi 

Around nineteenhundert it was clear that serial scanning is the right approach to 
image transmission, ,especially for fax transmission. After Arthur Korn (1904) 

the german physicist Max Dieckmann developed a successful fax system in 1906, 
which used a precursor of the modern television picture tube in the receiver, 

But it became also clear that xke with the seleninn cells-technology moving images 
could never be. transmitted in real time. The replacement of selenium cell Erougn, 
etn coals “ae Ne i as possible A photoelecerie aia. : Giese —_— 
vacuum tube that produces electrical current when illuminated. But electrical 


amplification was needed to make the photoelectric tube work (see the Elster/Geitel - 
ibe). qT. -Thorne Baker perfected the Bakewell-Bain scanning method and transmitted 


hindwritten documentg and drawings 1908. 
The russian TV pioneer Boris Rosing devised a television system very similar to the 


fax machine of Dieckmann, but with a photocell. He also used a primitive picture 
tube. 1911 Rosing transmitted moving images. But the premier figures in 
mechanical television are John Logie Baird and Charles Francis Jenkins. 

Jenkins transmitted silhouettes of objects in Washington 1923. Baird used 

a Nipkow disk to perform ee at both the transmitter and the receiver, 30 


scan lines per second, Berta transmitted the face of a mannequin 1926 in London. 





Sine 1928 in USA and 1931 in England mechanical television regular broadcasts 
began. But mechanical television did not last long due to amateurish programs 
and technical flaws. 1936 BBC of London bought the electronic television 
system of Philo Farnsworth from San Francisco and inaugurated the mddern television 
age. Mechanical television was also not a mass medium. Only around 1lo.ooo 
peoble have purchaaed receivers in th@US. After the second world war, when 
the audiences started to embrace the new electrénic television system, 
mechanical television was forgotten. 
But it was mechanical television, at that time also called "Radiovision" | 
that has inspired the foremost inventor of the electronic television system, 

a farm-bred lad . 
Philo T. Farnsworth. Farnsworth was 14 years old, when he learned about the electron: 
That a stream of electrons diverted in a vacuum by a magnetic field striking 
a photo-sensitive surface would produce light. So he got the idea to use manipulated 
electrons instead spinning discs to produce television. 1922, when he was 16, 
he came up with a camera tube, laéer to be called the 'Image Dissector". 
September 7,1927 Farnsowrth demonstrated his electronic television, filed it in 
as apatent which he got 1930. He had a patent interference ae ae the other 
inventor of the new electronic television system, Dr. Vladimir K. Zworykin 
from Westinghouse Company. Zwoykin had filed a camera tube, the "i consscope", 
as patent application in 1923. R.C.A. 's tv camera, the 'lmage Orthicon", from 1934, 
lost also a patent interference against Farnsowrth. Since Zworkyn' s tube was 
incapable of changging an optical image into an electrical as claimed , the patent 
examiners ruldd that Farnsworth was the true originator of Electronic Television, wtt 
22-yerars. Farnsworth basic idea was to scan an optical image row By tow, 
from left to ro@ght. This would be converted into an electron image. The charge of 
each spot would correspond to the light value of the particular part of the optical 
image With his dissector tube (comprising a cell having a photosensitive plate) 


and his straight line scamming method (a scanning under the control of a straight 


line wave form) Farnsowrth formed an electrical image and traifversed each elementary 


area of the electrical image by an electric shutter i a velocity sufficient 





to cofer the entire image within the optical peroid. The National Television System 
Commitee (NTSC) recommended 525 lines per re sec. in 1940 as standard. 1940 also 
beamed CBS the first color transmission from iy, eee ae building. In the 1950's 


color television set off. 


The Video Age 

The video age begins 1956, when Charles Ginsburg and Ray Dolby of Ampex Corp. 
developed the first videotape (recorder). Before the advent of magnetic tape 
television was a transmission of live events, live images. Nothing could 

be recorded. The Bing Crosby Productions did the first experimental video= 
recordings 1950 with a modified audio recorder that ran at loo inches per second. 
But ‘nated video recording was impractical and used too much tape. 

Before 1956 programming was either live or was reproduced from kinescope films. 

The transmission of moving images by electronic means fad to be coupled with 
magnetic image storage to produce Video. Technically speakinglis Video “Af 
Televsion plus magnetic storage. Without the tape there would be no. video art : 

no mean to document and store a performance, but also no mean for later 
postproducing the stored image. VIR (videotape recording) is the cue to video 

art: the electronic image plus magnetic storage. 

When videotape recording was introduced 1956 as a commercially viable product, 

it filled a definite need. The Quadruplex videotape xmas machines had 4 video 
heads on a cylinder. 1959 Quad video recording was refined to accomodate color. 

The 2-inch quad VIR was improved over the years and led to the development of — 
models (1965). But in the eraly 60's a new recording system was invented by ye 
Helical scan. It used l-inch tape and had a different concept than quad. ee 4 
four heads writing weteig trasversély across the tape, one track containing an enti 
field ran diagonally across the tape. The tape was wrapped around the head in a spir 
in order to create the slant track.Because several heads were placed on the drum 


in balanced pairs, both assembly and insert editing became mich simpler. The 


helical recording with its two heads mounted 180 degree apart on a rotating 


We ks aed 





drum made not only ees cinematic metaphox of the wheel ” the disk, the drums 
but also made eee the etelm cinematic cut, since it became a technical 
futility, an easy thing to do mechanically. When the cut reached a frenzy in 

the avantgarde movies of the fifties, it was exactly at the historical moment , 

when a technological invention®rose, the VIR, with its great postproduction 
possibiliti@s, which made cinematic cutting obsolete. Also the fact that the tape wa: 


usable and could be played back instantely changed the aestehtéic of the moving imag 
In the late 60's Helican scan appeared in the 3/4 inch U-matic format, 


making the outside production easier possible amd the cassette made tape easier to 
handle. 1967 Sony brought also the first 1/2 inchb/w portable video recorders, 

1970 the first color portabacks. 
the portabacks ;6f"fhe market , _ 1975 Sony came up with a new helical scan format: 
Betamax for home video recording . JVC rivals 1977 with VHS format. In the 
late 7o's portable home VCR's and inexpensive color cameras were available. 
The electronic image, on the basis of its magnetic storage, was nog longer 


monopolized by the state and by the industry, but personalized and individually 


accessible. 
v 


_— +a " m+ ) -significally 

When the danish engineer Valdemar Poulsen 1898 xa year after Braun has invented 

his tv tube, first proved the capability of information storage through magnetic 

tape, he could not know what thas one day would mean for the image. Because his 

device was thought to record sound. The magnetic recording process starts when 

a medium is moved at a constant speed in the vicinity of a varying magetic field, 

the variations representing information to be recorded. Poulsen's ''Telegraphone"' 

(a logical extension of the telegraph and the fax magkxaex transmission) recorded 

speech kg magnetically to wire. All the decades afterwards the idea remained 

to use magnetic tape for sound recording only. In the 40's german engimeers 

made progress in the evolution of tape recording and produced the magnetophone, 

an audiotape recording machine. This machine, With ae general access of magnetic 
AL Me GO'S 


tape on consumer basis [Soe ie basis for the musique concrete oT other 


forms of tape music which made manipulation with real sound, loop methods etc 


aS. 





possible. Only 1956 the first image videotape recorder wag developed. Tape 
music vs already reached a climax at that time and should help to engender 
new musical movements like minimal music. Video art is therefore comparable to 
the early tape music. Video art is working with tape images. Tape image like 
tape music cauld be the appropriate name for video art, or magnetically taped 


electronic imace. 





Layer versus Montage { 


Elements of an aesthetic of the ftape~and electronicak image 


a emphasige the tape character of the electronic image so much, because 

the storage technology of the electronic image jMvehas renders also the basis 

for some aesthetic aspects. From the first adurate scan demonstration to the 

development of the latest products in 8 mm and even 1/4 inch helical-scan 

systems, certain fimdamental features have prevailed. 

The bandwidth of the recorded and reproduced signal is determinde, to a great 

extent, by the velocity of the tape motion relative to the recording head. The higher 

the writing speed, the wider the recordable bandwith. The complexity of any videotape 
format is increased by the matter of including one or more audio, control and 


C idee. See ; 
even data or time-@ode tracks with the video. 
SS grace aR we. ones —_—_—_———— Stata ad ee ee 


Macking more tracks menas you can pack more information on the tape, comparable 





to the studio situation where more channels can put more instruments and 
| CVE Hg A wulk wade Sound 
sound effects on the audiotape, {That a tape can be rerun, can be reused, can 
, ig ee 
be played back immediately, can have multitrackings\ are corresphding features. 
Provided the adequate technology a tape must not be totally erased when played 
J 
back. tmstead By being played back and reused, additional iformation can be stored 


on the tape, like with audio tapes "Rerun, Playback, Tracking can be considered 


as corresponding concepts - the aesthetical correspondence of which is layering. 
Macking tracks means lay ing more information 8 the tape. The information is 
not stored or assembled serially like in the cut, the information is stored 
parallely on tracks of the same videotape. Because of its technology layering 
is the basic procedure of the tape image and not the cut, which is the basic 
two different histories of the 

procedure for the cinematic image. The/foving image which stafrted out from 

the same optico-physiological discoveries are finally split into two opposing 


basic strategies. 


I see découpage and montage as the two adversary poles of the cutting principle. 





The cut evidently is the negessary mean to make transitions from pictures to 
® pictures, from scenes to scenes, from times to times, from spaces to spaces, 
from one image of a space to another image of the same or another space, from 
the image of a person, an object to another image of the same or another person 


or object. The diffemence between to pahses of motion in two Erames es 
/ 


provides the illusion of motion,is extended to the difference between two images 
or scenes, or spacetimes. The cut is the visible format of the basic difference , 
on which the illusion of motion is built. Découpage is an aesthetic strategy 
which tries to avoid thgis difference, which tries to cut in such a way that 
the cut is not seen. Découpage wants to continue the illusion of motion 
also on a materialistic and formal basis, wants to heighten the illusion of 
continuity itself Decoupage 's ideal is a continuous flow of imageswith 
no abrupt interruption. Montage is just the contrary. Montage wants to 
vuptere Break downy te counhurd 

@ emphasize the cut, the asian) | to the point where every frame is different 
from the previous one. Montage is the art of the cut, making use of the cut in 
a visible formal way. Therefore découpage is applied in the narrative cinema 


and monatge led to the formal cinema of the avantgarde film, especially of the 


5o's and 60' s. 


: ee If montage is the art of the cut, layering is the art of the tracking. (y layewst 
€ G Bifferent awk Para d ~~ 
Imagesare not serpially connected like in the cut,\Layering’means to give up 


the concept of the total image and start to work with parts of an image,Layering 
| | is a particle aesthetic. By layering many different parts of many different 

images are layed parallely on top of each other. The concept of simultaneity . 

which was Heed: so often by Eisenstein and others,was not really achieved by 

montage, which is a serial technique. The true achievment of simultaneity is 

layering. Images of different spaces, times, objects and persons, partially or 
®@ whole (digitally miniaturized), are layed on top of each other. A multitude 

of images is floating around in the video space as consequence of the basic 


tape technique which is layering, grounded by its very own technology. 











In Woody Vasulkas opera ''The Art of Memory" from 1987 or in John Sanborns work 
of the last 3 years or in my own work you will find a lot of layering techniques. 
An especiallynice battle between cut and layering you can find in the work 
"Steps'' (1987) from Zbifiew Rybzcynski, which is just demonstrating the 
opposition wxkk between & montage and layering using the famous montage sequence 


“odessa steps" from Eisenstein. 
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; Layering is a breakthrough in representations techniques in the moving image. 


The cinematic image rarely touched the picture elements within the frame. 

Only the most advanced formal film like collage films composed the images 

with different particles of the real. Even superimpesition, based on the 

early Thaumatrope technique, worked most of the time with the totality of the two 
images. Layering is therefore not obly a new\ay of transition between images 
(like the cut), but also within the image itself. The information generated 
through the cut happens between two frames or two images. The information 
generated trough layering happens within the elements of the image itself. 

The realistic reference is borken down which was not the case in the cut.The 
cinematic technology favored cut and superimposition as its two basic structures. 
Bukxnakuxativxum The electronic technology favors layering and 

its proliferations. The very nature of esieteion - pot only the tracking 

technology alone - heads toward layering. In television an image is sent 

by radio waves as eae of dots (pixels), 300.000 ,which change 30 times 

a second, This field of humdertthousands variabl&, always changing spots 
absolutely 

shows you the elctronic image as hl discontinuous field (opposite to the 


dissecting 
cinematic image). This and the electronic line scarming (amammingxdane 





each image into hundreds of lines) and the tracking storage on tape generate 
a technique of representati Fae. ee wich is completely different 
from the more mechanical technique of cinematic representation. This new Aiecetege 
technology of representation cannot be restricted to cuts or superimpositions - 
this would violate their ow} technical luws. This new technology of representation 1 
be consisered just to the contrary as an extension of the grammar of the moving 
image and therefore also of the cinematic image. And naturally, when you look 

back, you will find a whole array of cinematographic effects , through which the 
cinema itself tried to extend its grammar, These effects are in some way forecasting 


on a mechanical basis the digital effects of today. 











Glass-shots, where parts of a scene have been painted on a glass or 

photo-cut-#uts combine with the real scene, all ih of mate paintings, 

mirror shots like the famous Schufftan effect, in the camera matte shots, 

rear projection, front projection, rotoscoping and especially optical printing 

whigbh is a direct link between cinema and video, - all these difficult to 

execute effects can be seen.as cinematic versions of contemporary digital effects / 

built on more or less mechanical, techniques of representation. 

The grammar of special effects can be compared to poetry, to experimental 

poetry where, too, not the content tells the story, but the form, where the 

ways of representation, the means of language itself constitute the meaning. 
Everybody has learned to except the artificiality of the cut Sei coaeaien 

and the superimposition as naive frammar of the moving image how to handle 

transitions of images,spaces,times. Nobody finds ist too simple that a cut 

does not make a difference between a cut showing two persons in the same 

room “ia shwoing two different images of the same person or that we cut from 

one a. to another place or from one time to another time. The cul Befieves 

in isotopic and isochrenic Space and time, which is natural spacetime . But 

the very cut itself destroys natural spacetime,therefore it is mm=xs less 

illusionistic to show kak formally, to exhibit this destruction of spacetime 

and to visualize the new social electronic eee, whichis a parallel and ~w.se— 

even plural, multiple spacetime, ?° Ry top: om “pow aud pe hy Avore Aue 
Artits, experimental filmmakers, who have been sensitive to these problems ,, 

tried therefore very often to go beyond the limits of the cut in cinema. They 

used all kinds of matrixes like Peter Rose or Paul Winkler or Zbigniew Rybzcynsk1. 

They used time consuming operations on the optical printer like Henry Jesionka © 

to make partial superimpositions or windiwing effects, or they invented split 

screen effects like John Whitney sr. If the cinematic commmity accepted the 


cut and the superimposition as techniques of transition, then it should also 


accept the extension of these techniques through the electronic or taped image. 
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bh 
switching masks etc are\formal extensions of the grammar of the moving image, 


Because the special effect like wipes, dissolves, windowing, key effects, 





extending cut and superimpositon,using the new scanning and tracking technology 
of the electronic and magnetic tape industry. This can be demonstrated naturally 
on pur formal ground, too. 
Instead of alternate images A and B serially (by cutting), you can superimpose 
themor you can show them side by side simultaneously Gis screen). Then you 
reduce the totality offithe superimpositian and make partial superimpositions. 
These partial apenas: Gs can es shapes or any shape,therefore the 
are heading towards windows. From the split screen, which is the first_mad— 
matrix, you can go forward to a quadruple split screen, then you can double this 
and you get a screen matrix of 16 images , finally of 32 images etc. The images can b 
the same or different ones. The superimposition must not be stationary. The new 
image can move in, from different directions, as a wipe, Even the form of the wipe 
can be different, regular or jagged. The superimpsetion can be Stationas~er— 
temporary,in that case it is a dissolve from one image to another. But the dissolve 
mist not go from image to image, but also can go from image to black or from 
black to image, then we have fade outs and ins and ups hen you take from the 
partial superimposition the transparency, then again you get Layering techniques 
or mask techniques or even keying techniques. We have to cnewe bet RQA. 
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